Information processing method, information processing system, and program

ABSTRACT

An information processing method, which is executed by a computer, includes detecting a first state in which an object is separated from an operation surface by a prescribed distance. detecting a second state in which the object comes in contact with the operation surface after the first state is detected. executing a first process which includes reading data from a first storage device and loading, into a second storage device, the data that are read, in response to the detecting of the first state, and executing a second process with respect to the data loaded into the second storage device, in response to the detecting of the second state.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of InternationalApplication No. PCT/JP2020/045808, filed on Dec. 9, 2020, which claimspriority to Japanese Patent Application No. 2020-050818 filed in Japanon Mar. 23, 2020. The entire disclosures of International ApplicationNo. PCT/JP2020/045808 and Japanese Patent Application No. 2020-050818are hereby incorporated herein by reference.

BACKGROUND Technological Field

The present disclosure relates to technology for loading data into astorage device.

Background Information

A configuration in which data stored in a storage device are temporarilystored in cache memory to realize high-speed access to the data has beenwidely used in the prior art (for example, refer to Japanese Patent No.981960).

SUMMARY

However, in the conventional configuration, the data are loaded after auser has issued an instruction to use the data, for example, making itdifficult to sufficiently reduce the delay between the user'sinstruction and the actual processing of the data. Given thesecircumstances, an object of one aspect of the present disclosure is topromptly start processing of data stored in a storage device.

An information processing method according to one aspect of the presentdisclosure is executed by a computer and comprises detecting a firststate in which an object is separated from an operation surface by aprescribed distance, detecting a second state in which the object comesin contact with the operation surface after the first state is detected,executing a first process which includes reading data from a firststorage device and loading, into a second storage device, the data thatare read, in response to the detecting of the first state, and executinga second process with respect to the data loaded into the second storagedevice, in response to detecting of the second state.

An information processing system according to one aspect of the presentdisclosure comprises an electronic controller including at least oneprocessor. The electronic controller is configured to execute aplurality of modules including a state detection module configured todetect a first state in which an object is separated from an operationsurface by a prescribed distance, and detect a second state in which theobject comes in contact with the operation surface after the first stateis detected, a first processing module configured to execute a firstprocess which includes reading data from a first storage device andload, into a second storage device, the data that are read, in responseto the state detection module detecting the first state, and a secondprocessing module configured to execute a second process with respect tothe data loaded into the second storage device in response to the statedetection module detecting the second state.

A non-transitory computer readable medium storing a program according toone aspect of the present disclosure causes a computer to execute aprocess that comprises detecting a first state in which an object isseparated from an operation surface by a prescribed distance, detectinga second state in which the object comes in contact with the operationsurface after the first state is detected, executing a first processwhich includes reading data from a first storage device and loading,into a second storage device, the data that are read, in response to thedetecting of the first state, and executing a second process withrespect to the data loaded into the second storage device, in responseto the detecting of the second state.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating the configuration of aninformation processing system.

FIG. 2 is a schematic diagram illustrating the configuration of adetection unit.

FIG. 3 is a block diagram illustrating the functional configuration of acontrol system.

FIG. 4 is an explanatory diagram relating to the state of a user's hand.

FIG. 5 is a flowchart illustrating the specific procedure of a controlprocess.

FIG. 6 is a block diagram illustrating the configuration of acommunication system according to a third embodiment.

FIG. 7 is a flowchart illustrating the specific procedure of a firstprocess in the third embodiment.

DETAILED DESCRIPTION OF THE EMBODIMENTS

Selected embodiments will now be explained in detail below, withreference to the drawings as appropriate. It will be apparent to thoseskilled from this disclosure that the following descriptions of theembodiments are provided for illustration only and not for the purposeof limiting the invention as defined by the appended claims and theirequivalents.

A: First Embodiment

FIG. 1 is a block diagram illustrating the configuration of aninformation processing system 100 according to a first embodiment of thepresent disclosure. The information processing system 100 is a computersystem that executes a process in accordance with an operation by auser. The information processing system 100 has a control system 1 and adetection unit (detector) 2. The detection unit 2 is an input devicethat detects the user operation. The control system 1 executes a processin accordance with the operation detected by the detection unit 2.

The control system 1 includes an electronic controller (control device)10, a first storage device 11, a second storage device 12, and a soundoutput device 13. The control system 1 is realized, for example, by aninformation terminal such as a smartphone, a tablet terminal, or apersonal computer. The control system 1 can be realized as a singledevice, or as a plurality of separate devices.

The electronic controller 10 is one or a plurality of processors thatcontrol each element of the control system 1. Specifically, theelectronic controller 10 can be configured to comprise one or more typesof processors, such as a CPU (Central Processing Unit), an SPU (SoundProcessing Unit), a DSP (Digital Signal Processor), an FPGA (FieldProgrammable Gate Array), an ASIC (Application Specific IntegratedCircuit), and the like. The electronic controller 10 generates an audiosignal X in accordance with the user operation. The term “electroniccontroller” as used herein refers to hardware that executes softwareprograms.

The sound output device 13 emits sound (hereinafter referred to as“target sound”) represented by the audio signal X generated by theelectronic controller 10. The sound output device 13 is, for example, aspeaker or headphones. The D/A converter that converts the audio signalX from digital to analog and the amplifier that amplifies the audiosignal X have been omitted from the figure for the sake of convenience.Further, the example shown in FIG. 1 shows a configuration in which thesound output device 13 is provided within the control system 1. Inanother example, the sound output device 13 can be separated from thecontrol system 1 and connected to the control system 1 wirelessly or bywire.

The first storage device 11 includes one or more storage media (computermemories) for storing a program to be executed by the electroniccontroller 10 and various data that are used by the electroniccontroller 10. The first storage device 11 is a storage medium that hasa larger storage capacity and slower read speed than the second storagedevice 12. A storage device, including non-volatile storage media suchas a magnetic storage medium or an optical recording medium, is used asthe first storage device 11. The first storage device 11 stores, inaddition to programs executed by the electronic controller 10, controldata C which are used for generating the audio signal X. The controldata C are, for example, waveform data in the time domain representing asound waveform. Specifically, the control data C representingperformance sounds of various musical instruments, such as percussioninstruments, are stored in the first storage device 11.

The second storage device 12 includes one or more storage media(computer memories) for storing a program that is executed by theelectronic controller 10 and various data that are used by theelectronic controller 10, in the same manner as the first storage device11. The second storage device 12 is a storage medium that has a smallerstorage capacity and faster read speed than the first storage device 11.A volatile or non-volatile storage device, including storage media suchas a semiconductor recording medium, is used as the second storagedevice 12. For example, a main storage device or cache memory is used asthe second storage device 12. The electronic controller 10 executesprograms loaded into the second storage device 12 from the first storagedevice 11 to realize various functions.

FIG. 2 is a schematic diagram illustrating the configuration of thedetection unit 2. The detection unit 2 has a housing 20, a firstdetector 21, and a second detector 22. The housing 20 is a hollowstructure that houses the first detector 21 and the second detector 22.More specifically, the housing 20 has an enclosure portion 20 a and alight transmission portion 20 b. The enclosure portion 20 a is abox-shaped structure that has an internal space and that is open at thetop. The light transmission portion 20 b is a plate-shaped member thatcloses the opening of the housing portion 20 a. The light transmissionportion 20 b transmits light in a wavelength range that can be detectedby the first detector 21. The light transmission portion 20 b has anoperation surface (striking surface) F, which is the surface opposite tothe surface facing the enclosure portion 20 a. The user can move his orher hand H close to or away from the operation surface F and can strikethe operation surface F with his or her hand H. The user's hand H is oneexample of an “object.”

The first detector 21 is an optical sensor that detects the state of theuser's hand H. The first detector 21 is installed in the vicinity of themidpoint (center) of the bottom surface of the enclosure portion 20 a.Specifically, a distance-measuring sensor that measures the distancebetween the object and a light-receiving surface is used as the firstdetector 21. For example, the first detector 21 generates a time-seriesdetection signal Q1 that represents the position of the hand(specifically, the distance from the light-receiving surface to the handH) in a direction perpendicular to the operation surface F by receivingthe light reflected from the hand H that has passed through the lighttransmission portion 20 b. The detection signal Q1 is transmitted to thecontrol system 1 via wired or wireless communication. The light detectedby the first detector 21 is not limited to visible light. For example,invisible light, such as infrared light, can be detected by the firstdetector 21.

The second detector 22 is a sensor for detecting the contact of the handH with the operation surface F. For example, a sound collection devicethat collects ambient sound is used as the second detector 22. Thesecond detector 22 collects the striking sounds generated when theuser's hand H strikes the operation surface F. The second detector 22generates a detection signal Q2 that represents ambient sounds whichinclude striking sounds. The detection signal Q2 is transmitted to thecontrol system 1 via wired or wireless communication. The seconddetector 22 can be installed outside of the housing 20.

FIG. 3 is a block diagram illustrating the functional configuration ofthe control system 1. The electronic controller 10 of the control system1 loads programs stored in the storage device 11 into the second storagedevice 12 and executes the programs to realize a plurality of functions(state detection module (state detection unit) 30, first processingmodule (first processing unit) 31, and second processing module (secondprocessing unit) 32).

The state detection module 30 detects the state of the user's hand H inaccordance with the detection result (detection signal Q1 and detectionsignal Q2) of the detection unit 2. More specifically, the statedetection module 30 detects a first state or a second state as the stateof the hand H. As shown in FIG. 2 , in the first state, the hand H isseparated from the operation surface F by a prescribed distance(hereinafter referred to as “reference value”) Dref. In the secondstate, the hand H is in contact with the operation surface F.

FIG. 4 is an explanatory diagram pertaining to the state of the hand H.The state detection module 30 analyzes the detection signal Q1 generatedby the first detector 21 and detects that hand H is in the first state.More specifically, the state detection module 30 analyzes the detectionsignal Q1 and calculates the distance D between the operation surface Fand the hand H. The calculation of the distance D is repeated at aprescribed cycle. That is, time-series data are generated that representthe distance D. Any known technology can be used to calculate thedistance D. FIG. 4 illustrates temporal changes in the distance D. Thestate detection module 30 determines that the hand H is in the firststate when the distance D between the operation surface F and the hand Hmatches the reference value Dref. The state detection module 30 can alsodetermine that the hand H is in the first state when the distance D isincluded in a prescribed allowable range that includes the referencevalue Dref. The reference value Dref is a preset fixed value. However,the reference value Dref can be changed in accordance with aninstruction from the user.

The state detection module 30 also detects that the hand H is in thesecond state by analyzing the detection signal Q2 generated by thesecond detector 22. More specifically, the state detection module 30calculates a volume V of the sound represented by the detection signalQ2. The calculation of volume V is repeated at a prescribed cycle. Thatis, time-series data are generated that represent the volume V. Anyknown technology can be used to calculate the volume V. FIG. 4illustrates temporal changes in volume V. When a striking sound isgenerated when the operation surface F is struck, there is an abruptincrease in the volume V. When the volume V exceeds a prescribed value(hereinafter referred to as “reference value”) Vref (that is, when thestriking sound is collected), the state detection module 30 determinesthat the hand H is in the second state. The reference value Vref is apreset fixed value. However, the reference value Vref can be changed inaccordance with an instruction from the user.

The user's hand H sequentially enters the first state and the secondstate in a series of processes of approaching the operation surface F.More specifically, the hand H is in the first state at a time point t1during the process of the hand H approaching the operation surface F,and the hand H is in the second state at a time point t2 which issubsequent to time point t1. That is, the hand H enters the first statebefore the second state. The time point t1 and time point t2 areseparated by an interval on the time axis.

If the state detection module 30 detects that the hand H is in the firststate, the first processing module 31 of FIG. 3 executes a first processfor loading the control data C stored in the first storage device 11into the second storage device 12. That is, the first process isexecuted at the time point t1 when the distance D reaches the referencevalue Dref in the process of the hand H approaching the operationsurface F. The first process includes a process for reading the controldata C from the first storage device 11 and loading the control data Cinto the second storage device 12.

If the state detection module 30 detects that the hand H is in thesecond state, the second processing module 32 executes a second processwith respect to control data C loaded into the second storage device 12.That is, the second process is executed at time point t2 when volume Vreaches a reference value Vref, subsequent to the first state in theprocess of hand H approaching operation surface F.

The second process is an acoustic process that generates acoustic signalX using the control data C loaded into the second storage device 12.More specifically, the second process adjusts the pitch of soundsrepresented by the control data C in accordance with the volume V of thedetection signal Q2 to generate the audio signal X. Therefore, the audiosignal X is generated that represents the target sound of the pitch thatcorresponds to the intensity with which the hand H strikes the operationsurface F. For example, the greater the intensity with which theoperation surface F is struck is, the higher the pitch of the audiosignal X is generated. The contents of the second process are notlimited to the example described above. For example, the secondprocessing module 32 can execute, as the second process, an effectimparting process for imparting an acoustic effect, such as areverberation effect, to the control data C, or a filtering process forchanging the frequency response of the sound represented by the controldata C. The target sound is generated by supplying the audio signal X,which is generated by the second processing module 32 by the secondprocess described above, to the sound output device 13. As can beunderstood from the foregoing explanation, the second process includes aprocess for generating sound in accordance with the control data Cloaded into the second storage device 12.

FIG. 5 is a flowchart illustrating the specific procedure of a process(hereinafter referred to as “control process”) Sa executed by theelectronic controller 10. For example, the control process Sa isrepeated at a cycle that is sufficiently shorter than the cycle in whichthe user's hand H approaches and separates from the operation surface F.

When the control process Sa is initiated, the electronic controller 10(state detection module 30) analyzes the detection signal Q1 and thedetection signal Q2 supplied from the detection unit 2 to detect thestate of the user's hand H (Sa1). The electronic controller 10 (firstprocessing module 31) determines whether the state detection module 30has detected that the hand H is in the first state (Sa2). If the hand His in the first state (Sa2: YES), the electronic controller 10 (firstprocessing module 31) executes the first process for loading the controldata C stored in the first storage device 11 into the second storagedevice 12 (Sa3). On the other hand, if the hand H is not in the firststate (Sa2: NO), the first process is not executed.

If the hand H is not in the first state (Sa2: NO), or if the firstprocess is executed, the electronic controller 10 (second processingmodule 32) determines whether the state detection module 30 has detectedthat the hand H is in the second state (Sa4). If the hand H is in thesecond state (Sa4: YES), the electronic controller 10 (second processingmodule 32) executes the second process with respect to the control dataC loaded in the second storage device 12 (Sa5). The target sound isgenerated by supplying the audio signal X, which is generated by thesecond process, to the sound output device 13. On the other hand, if thehand H is not in the second state (Sa4: NO), the second process is notexecuted.

FIG. 4 shows, in a comparative example, a configuration in which thefirst process is started at the time point t2 when the hand H strikesthe operation surface F. In the comparative example, the second processis started at a the time point t3, after the end of the first process,which started at the time point t2. Therefore, the target soundrepresented by the audio signal X is output from the sound output device13 at a time point that is delayed with respect to the user's contactwith the operation surface F. In contrast to the comparative example, inthe first embodiment, if the hand H is detected to be in the firststate, the control data C are loaded into the second storage device 12.That is, the control data C are prepared in the second storage device 12before the hand H comes in contact with the operation surface F.Therefore, the second process can be started more quickly than in thecomparative example. More specifically, the second process can bestarted from the time point t2 when the user contacts the operationsurface F. Therefore, compared with the comparative example, the delayfrom the time when the user hand H comes in contact with the operationsurface F to the time when the target sound is generated is reduced.

Further, in the first embodiment, the first process and the secondprocess are executed sequentially in a series of processes from the timewhen the user's hand H approaches operation surface F until the time ofcontact therewith. Therefore, there is the advantage that the firstprocess is executed without the user being particularly cognizant thathis or her hand H is in the first state. That is, the user need onlymake contact with the operation surface F at the time that the targetsound is to be generated, and the user is not required to consciouslyinstruct the first process before producing the target sound.

B: Second Embodiment

The second embodiment will be described below. In each of the followingembodiments, elements that have functions that are similar tocorresponding elements in the first embodiment have been assigned thesame reference numerals that were used in the description in the firstembodiment and their detailed descriptions have been appropriatelyomitted.

The information processing system 100 according to the second embodimentgenerates a target sound having an acoustic characteristic correspondingto a position where the hand H comes in contact with the operationsurface F (hereinafter referred to as “striking position”). The firststorage device 11 stores M (N0) (where M is an integer greater than orequal to 2) pieces of the control data C, respectively corresponding toa plurality of different striking positions. The acoustic characteristic(for example, tone) of the sound represented by each piece of thecontrol data C is different for each piece of the control data C.

If the hand H is detected to be in the first state, the first processingmodule 31 of the first embodiment reads one piece of the control data Cfrom the first storage device 11 and loads it into the second storagedevice 12. If the hand H is detected to be in the first state, the firstprocessing module 31 of the second embodiment reads N pieces (where N isan integer greater than or equal to 2 and less than or equal to M) ofthe control data C out of the M pieces of the control data C stored inthe first storage device 11 and loads them into the second storagedevice 12.

Specifically, the first processing module 31 identifies the position ofthe hand H (hereinafter referred to as “temporary position”) at the timepoint t1 when the hand H is detected to be in the first state. Thetemporary position is the position of hand H on a plane parallel to theoperation surface F and corresponds to the temporary striking positionuntil the hand H actually comes in contact with the operation surface F.The actual striking position, although not precisely coincident with thetemporary position, is expected to be close to the temporary position.The first processing module 31 loads into the second storage device 12 Npieces of the control data C, which correspond to striking positionsclose to the temporary position, from among the M pieces of the controldata C stored in the first storage device 11. That is, the control dataC that correspond to the striking position predicted by the temporaryposition of the hand H in the first state are loaded into the secondstorage device 12. Therefore, of the M pieces of the control data Cstored in the first storage device 11, the combination of the N piecesof the control data C loaded into the second storage device 12 changesin accordance with the temporary position at the time point t1. In otherwords, the N pieces of the control data C are candidates of the controldata C for which the second process should be executed. The N pieces ofthe control data C are an example of the “plurality of pieces of data.”

When the user's hand H is in the second state, the striking positionwith respect to the operation surface F becomes fixed. The secondprocessing module 32 executes the second process with respect to onepiece of the control data C corresponding to the actual strikingposition, from among the N pieces of the control data C loaded into thesecond storage device 12. For example, one piece of the control data Ccorresponding to the striking position closest to the position of thehand H on the operation surface F at the time point t2 (that is, theactual striking position with respect to the operation surface) isselected from the N pieces of the control data C stored in storagedevice 12 as the target of the second process. The contents of thesecond process are the same as in the first embodiment. That is, thesound output device 13 emits a target sound having the acousticcharacteristic corresponding to the striking position. As can beunderstood from the foregoing explanation, the second process in thesecond embodiment is a process for generating a sound in accordance withany one of the N pieces of data loaded into the second storage device12.

The same effects as those of the first embodiment are realized in thesecond embodiment. In a configuration in which N (i.e., plural) piecesof the control data C are loaded into the second storage device 12, moretime is required for the first process than in the first embodiment inwhich one piece of the control data C is loaded into the second storagedevice 12. Therefore, in the comparative example in which the firstprocess is initiated at the time point t2 when the hand H strikes theoperation surface F, if a plurality of pieces of the control data C areloaded into the second storage device 12, the delay in the generation ofthe target sound becomes particularly pronounced. In consideration ofthe circumstances described above, a configuration in which the firstprocess is executed at the time point t1 when the first state isdetected for the purpose of reducing the delay of the target sound isexceptionally effective in a configuration in which a plurality ofpieces of the control data C are loaded into the second storage device12, as in the second embodiment.

In the second embodiment, a case in which N pieces of the control data Ccorresponding to the temporary position from among the M pieces of thecontrol data C corresponding to different striking positions are loadedinto the second storage device 12 is used as an example, but theconditions for selecting the N pieces of the control data C are notlimited by the example described above.

For example, it is possible to conceive of a first aspect for generatinga target sound having an acoustic characteristic corresponding to thedirection in which the user's hand H moves with respect to the operationsurface F (hereinafter referred to as “direction of movement”). Thedirection of movement is the angle of the movement of the hand H withrespect to the operation surface F (or a line perpendicular to theoperation surface F). In the first aspect, M pieces of the control dataC respectively corresponding to a plurality of different directions ofmovement are stored in the first storage device 11. The first processingmodule 31 loads into the second storage device 12 N pieces of thecontrol data C, which correspond to temporary directions of movement atthe time point t1, from among the M pieces of the control data C storedin the first storage device 11. The second processing module 32 executesthe second process with respect to one piece of the control data C,which corresponds to the definitive movement direction at the time pointt2, from among the N pieces of the control data C loaded into the secondstorage device 12.

Further, it is possible to conceive of a second aspect for generating atarget sound having an acoustic characteristic corresponding to thespeed with which the user's hand H moves with respect to the operationsurface F (hereinafter referred to as “movement speed”). In the secondaspect, M pieces of the control data C corresponding to a plurality ofdifferent movement speeds are stored in the first storage device 11. Thefirst processing module 31 loads into the second storage device 12 Npieces of the control data C, which correspond to temporary movementspeeds at the time point t1, from among the M pieces of the control dataC stored in first storage device 11. The second processing module 32executes the second process with respect to one piece of the controldata C, which correspond to the definitive movement speed at the timepoint t2, from among the N pieces of the control data C loaded into thesecond storage device 12.

C: Third Embodiment

FIG. 6 is a block diagram illustrating the configuration of acommunication system S according to a third embodiment. Thecommunication system S is a server-client system including theinformation processing system 100 and a storage system 200. Theinformation processing system 100 and the storage system 200 cancommunicate with each other via a communication network 300, such as theInternet.

The information processing system 100 has a configuration in which thefirst storage device 11 in the first embodiment is replaced with acommunication device 14. The communication device 14 communicates withthe storage system 200 via the communication network 300. The term“communication device” as used herein includes a receiver, atransmitter, and/or a transmitter-receiver, and contemplates any deviceor devices, separate or combined, capable of transmitting and/orreceiving communication signals. The storage system 200 is a serversystem including the first storage device 11 in which is stored controldata C.

FIG. 7 is a flowchart illustrating a specific procedure of a firstprocess (Sa3) of the control process Sa in the third embodiment. Whenthe first process is started, the electronic controller 10 (firstprocessing module 31) executes a transmission process (Sa31). Thetransmission process is a process for transmitting a request R for thecontrol data C from the communication device 14 to the storage system200 (first storage device 11) via the communication network 300.

When the request R is received from the information processing system100 (Sb1), the storage system 200 reads the control data C stored in thefirst storage device 11 (Sb2). The storage system 200 transmits thecontrol data C to the information processing system 100, which is thesource of the request (Sb3).

The electronic controller 10 (first processing module 31) of theinformation processing system 100 executes a reception process (Sa32).The reception process is a process for receiving control data Ctransmitted from the storage system 200 by the communication device 14and storing the control data C in the second storage device 12. As canbe understood from the foregoing explanation, the first process in thethird embodiment includes the transmission process (Sa31) and thereception process (Sa32). In the second embodiment, if the user's hand His detected to be in the first state, the control data C stored in thefirst storage device 11 are loaded into the second storage device 12, inthe same manner as in the first embodiment.

The same effects as those of the first embodiment are realized in thethird embodiment. Further, in the third embodiment, since the controldata C are stored in the first storage device 11 of the storage system200, there is no need that the first storage device 11 be kept in theinformation processing system 100. Therefore, there is the advantagethat the storage capacity required for the information processing system100 can be reduced.

In a configuration in which the information processing system 100receives the control data C from the first storage device 11 via thecommunication network 300, as in the third embodiment, there are casesin which the time required by the first process can become lengthy due,for example, to a delay in communication in the communication network300. Therefore, in the comparative example in which the first process isinitiated at the time point t2 when the hand H strikes the operationsurface F, if the information processing system 100 acquires the controldata C via the communication network 300, the delay in the generation ofthe target sound becomes particularly pronounced. In consideration ofthe circumstances described above, a configuration in which the firstprocess is executed at the time point t1 when the first state isdetected for the purpose of reducing the delay in the target sound isexceptionally effective in a configuration in which the control data Care sent and received via the communication network 300, as in the thirdembodiment.

In the description above, embodiments based on the first embodiment areused as an example, but the same configuration as that of the thirdembodiment can be applied to the second embodiment in which N pieces ofthe control data C are loaded into the second storage device 12. Thatis, the first processing module 31 receives N pieces of the control dataC from among the M pieces of the control data C stored in the firststorage device 11 from the storage system 200 via the communicationnetwork 300, and stores the N pieces of the control data C in the secondstorage device 12.

D: Modification

Specific modified embodiments to be added to each of the aforementionedembodiment examples are illustrated below. Two or more embodimentsarbitrarily selected from the following examples can be appropriatelycombined insofar as they are not mutually contradictory.

(1) In the embodiments described above, the case in which the firstdetector 21 is a distance measurement sensor is used as an example, butthe type of the first detector 21 is not limited to the exampledescribed above. For example, an image sensor that captures an image ofthe user's hand H can be used as the first detector 21. In this case,the state detection module 30 analyzes the image of the hand H capturedby the first detector 21 in order to calculate the distance D anddetects the first state in accordance with the distance D. Further, aninfrared sensor that emits and receives infrared light can be used asthe first detector 21. In this case, the state detection module 30calculates the distance D from the intensity of the received infraredradiation reflected from the surface of the hand H. Further, theposition in which the first detector 21 is installed is arbitrary. Forexample, the first detector 21 can capture an image of the hand H fromthe side.

(2) In the aforementioned embodiments, the detection signal Q2 thatrepresents sounds that include striking sounds is analyzed to detect thesecond state, but the configuration and method of detecting the contactof the hand H with the operation surface F is not limited to the exampledescribed above. For example, the detection signal Q1 generated by thefirst detector 21 can be analyzed to detect contact of the hand H withthe operation surface F (that is, the second state). For example, thestate detection module 30 determines that the user's hand H is in thesecond state when the distance D identified from the detection signal Q1reaches zero. The second detector 22 is omitted in a configuration inwhich the detection signal Q1 is used for the detection of the secondstate. Further, a contact sensor (for example, an electrostaticcapacitive sensor) that detects contact of the hand H with the operationsurface F (light transmission portion 20 b), a vibration sensor thatdetects the vibration of operation surface F (light transmission portion20 b), or a pressure sensor that detects pressure from the hand H thatacts on the operation surface F can be used as the second detector 22.

(3) In the aforementioned embodiments, a configuration in which theuser's hand H comes in contact with the operation surface F is used, butthe object coming in contact with the operation surface F is not limitedto the hand H. For example, the user can strike the operation surface Fwith a striking member such as a stick for a percussion instrument. Ascan be understood from the examples described above, objects coming incontact with the operation surface F include both a part of the user'sbody (typically, hand H) and a striking member operated by the user. Ina configuration in which a striking member strikes the operation surfaceF, the first detector 21 or the second detector 22 can be mounted on thestriking member.

(4) The configuration of the housing 20 of the detection unit 2 isarbitrary. Further, the structure in which first detector 21 and thesecond detector 22 are housed in the housing 20 is not mandatory. Inother words, as long as the detection unit 2 includes the operationsurface F with which an object such as the user's hand H comes incontact, the specific structure and presence/absence of the housing 20are not particularly limited.

(5) In the aforementioned embodiments, the information processing system100 equipped with one detection unit 2 is illustrated. In anotherexample, the information processing system 100 can be equipped with aplurality of the detection units 2, respectively corresponding to aplurality of different pitches. In this case, the state detection module30 detects the first state or the second state for each of the pluralityof detection units 2. The first processing module 31 loads into thesecond storage device 12 one or more pieces of the control data C ofpitches that correspond to the detection unit 2 in which the first stateis detected, from among the plurality of pieces of the control data Crespectively corresponding to the plurality of different pitches, andthe second processing module 32 executes the second process with respectto the control data C of a pitch corresponding to the detection unit 2in which the second state is detected.

(6) In the aforementioned embodiments, the second process is executedwith respect to the control data C representing sound waveforms togenerate the audio signal X, but the contents of the control data C andthe second process are not limited to the example described above. Forexample, in a configuration that uses control data C that represent theconditions of the sounds of speech (phonemes, pitch, etc.), a speechsynthesis process for generating an audio signal X representing thesounds of speech is executed as the second process. Further, forexample, in a configuration that uses control data C generated in acompression process for the audio signal X, a decoding process thatgenerates the audio signal X from the control data C is executed as thesecond process.

(7) In the third embodiment in which the first storage device 11 isinstalled in the storage system 200, part of the second process can beexecuted by the storage system 200. In this case, the control data C,which has been subjected to part of the second process, are stored inthe second storage device 12 of the information processing system 100.The second processing module 32 of the information processing system 100executes the remaining part of the second process with respect to thecontrol data C stored in the second storage device 12.

(8) In the aforementioned embodiments, a configuration in which theuser's hand H actually comes in contact with the operation surface F isused as an example, but a configuration can be adopted in which the usertouches a virtual operation surface F using haptic technology (haptics)that employs tactile feedback, for example. In this case, the useroperates a simulated hand that exists in virtual space to contact theoperation surface F installed in the virtual space. By using a vibratingbody that vibrates when the operation surface F in virtual space istouched, the user perceives that he or she is actually in contact withthe operation surface F. As can be understood from the foregoingexplanation, the operation surface F can be a virtual surface in virtualspace. Similarly, the object (e.g., hand H) that comes in contact withthe operation surface F can be a virtual object in virtual space.

(9) As described above, the functions of the reproduction control system100 (particularly the function of the control system 1) used by way ofexample above are realized by cooperation between one or a plurality ofprocessors that constitute the electronic controller 10 and a programstored in the second storage device 12. The program according to thepresent disclosure can be provided in a form stored in acomputer-readable storage medium and installed in a computer. Forexample, the storage medium can be a non-transitory storage medium, agood example of which is an optical storage medium (optical disc) suchas a CD-ROM, but can include storage media of any known form, such as asemiconductor storage medium or a magnetic storage medium.Non-transitory storage media include any storage medium that excludestransitory propagating signals and does not exclude volatile storagemedia. Further, in a configuration in which a distribution devicedistributes the program via the communication network 300, a storagedevice that stores the program in the distribution device corresponds tothe non-transitory storage medium.

E: Additional Statement

For example, the following configurations can be understood from theforegoing embodiment examples.

An information processing method according to one aspect (Aspect 1) ofthe present disclosure is executed by a computer, and comprisesdetecting a first state in which an object is separated from anoperation surface by a prescribed distance, detecting a second state inwhich the object comes into contact with the operation surface after thefirst state is detected, executing a first process which includesreading data from a first storage device and loading the read data intoa second storage device when the first state is detected, and executinga second process with respect to the data loaded into the second storagedevice when the second state is detected.

By the aspect described above, since data are loaded into the secondstorage device when an object is detected to be in the first state, thesecond process can be more quickly executed as compared with aconfiguration in which the first process and the second process areexecuted after the object is detected to be in the second state.Further, the first process and the second process are sequentiallyexecuted in a series of processes from the time that the objectapproaches the operation surface until the time of contact therewith.Therefore, the first process can be executed without the user beingcognizant that the object is in the first state.

In a specific example (Aspect 2) of Aspect 1, the first process furtherincludes transmitting a request for the data to the first storage devicevia a communication network, and receiving via the communication networkthe data transmitted from the first storage device in accordance withthe request. In a configuration in which data are received from thefirst storage device via a communication network, the start of thesecond process is particularly prone to delay, due to communicationdelays in the communication network. Therefore, the configuration of thepresent disclosure in which the first process is executed when theobject is detected to be in the first state is particularly suitable fora configuration in which data are received from the first storage devicevia the communication network.

In a specific example (Aspect 3) of Aspect 1 or 2, the second processincludes generating a sound in accordance with the data loaded into thesecond storage device. By the aspect described above, delays in thesound generation can be reduced as compared with a configuration inwhich the first process and the second process are executed after theobject is detected to be in the second state.

In a specific example (Aspect 4) of Aspect 3, the data include aplurality of pieces of data, and the second process includes generatinga sound in accordance with any one of the plurality of pieces of dataloaded into the second storage device. In a configuration in which aplurality of pieces of data are loaded into the second storage device, alonger time is required for the first process as compared with aconfiguration in which one piece of data is loaded into the secondstorage device. Therefore, the configuration of the present disclosurein which the first process is executed when the object is detected to bein the first state is particularly suitable.

A typical example of the plurality of pieces of data are data forgenerating different musical sounds, for example. That is, a pluralityof pieces of data respectively generating a plurality of musical soundsare loaded into the second storage device before the transition to thesecond state. Then, for example, of the plurality of pieces of dataloaded into the second storage device, data selected in accordance withthe position of the object in the second state are used to generate themusical sounds.

An information processing system according to one aspect (Aspect 5) ofthe present disclosure comprises a state detection unit for detecting afirst state in which an object is separated from an operation surface bya prescribed distance and detecting a second state in which the objectcomes into contact with the operation surface after the first state isdetected, a first processing unit for executing a first process whichincludes reading data from a first storage device and loading the readdata into a second storage device when the first state is detected, anda second processing unit for executing a second process with respect tothe data loaded into the second storage device when the second state isdetected.

A program according to one aspect (Aspect 6) of the present disclosurecauses a computer to execute a process for detecting a first state inwhich an object is separated from an operation surface by a prescribeddistance, detecting a second state in which the object comes intocontact with the operation surface after the first state is detected,executing a first process which includes reading data from a firststorage device and loading the read data into a second storage devicewhen the first state is detected, and executing a second process withrespect to the data loaded into the second storage device when thesecond state is detected.

The present disclosure can be applied to an information processingmethod, an information processing system, and a program. The informationprocessing method us executed by the electronic controller 10 as acomputer.

What is claimed is:
 1. An information processing method executed by acomputer, the information processing method comprising: detecting afirst state in which an object is separated from an operation surface bya prescribed distance; detecting a second state in which the objectcomes in contact with the operation surface after the first state isdetected; executing a first process which includes reading data from afirst storage device and loading, into a second storage device, the datathat are read, in response to the detecting of the first state; andexecuting a second process with respect to the data loaded into thesecond storage device, in response to the detecting of the second state.2. The information processing method according to claim 1, wherein theexecuting of the first process further includes transmitting, to thefirst storage device via a communication network, a request for the datato be read, and receiving, via the communication network, the data readand transmitted from the first storage device in accordance with therequest.
 3. The information processing method according to claim 1,wherein the executing of the second process includes generating a soundin accordance with the data loaded into the second storage device. 4.The information processing method according to claim 3, wherein the datainclude a plurality of pieces of data, and the executing of the secondprocess includes generating a sound in accordance with any one of theplurality of pieces of data loaded into the second storage device.
 5. Aninformation processing system comprising: an electronic controllerincluding at least one processor, the electronic controller beingconfigured to execute a plurality of modules including a state detectionmodule configured to detect a first state in which an object isseparated from an operation surface by a prescribed distance, and detecta second state in which the object comes in contact with the operationsurface after the first state is detected, a first processing moduleconfigured to execute a first process which includes reading data from afirst storage device and loading, into a second storage device, the datathat are read, in response to the state detection module detecting thefirst state, and a second processing module configured to execute asecond process with respect to the data loaded into the second storagedevice, in response to the state detection module detecting the secondstate.
 6. The information processing system according to claim 5,wherein the second processing module is configured to, as the secondprocess, generate a sound in accordance with the data loaded into thesecond storage device.
 7. The information processing system according toclaim 6, wherein the data include a plurality of pieces of data, and thesecond processing module is configured to, as the second process,generate a sound in accordance with any one of the plurality of piecesof data loaded into the second storage device.
 8. A non-transitorycomputer readable medium storing a program that causes a computer toexecute a process, the process comprising: detecting a first state inwhich an object is separated from an operation surface by a prescribeddistance; detecting a second state in which the object comes in contactwith the operation surface after the first state is detected; executinga first process which includes reading data from a first storage deviceand loading, into a second storage device, the data that are read, inresponse to the detecting of the first state; and executing a secondprocess with respect to the data loaded into the second storage device,in response to the detecting of the second state.
 9. The non-transitorycomputer readable medium according to claim 8, wherein the executing ofthe first process further includes transmitting, to the first storagedevice via a communication network, a request for the data to be read,and receiving, via the communication network, the data read andtransmitted from the first storage device in accordance with therequest.
 10. The non-transitory computer readable medium according toclaim 8, wherein the executing of the second process includes generatinga sound in accordance with the data loaded into the second storagedevice.
 11. The non-transitory computer readable medium according toclaim 10, wherein the data include a plurality of pieces of data, andthe executing of the second process includes generating a sound inaccordance with any one of the plurality of pieces of data loaded intothe second storage device.